Automatic summarization of soccer highlights using audio-visual descriptors
Identifieur interne : 000081 ( Main/Exploration ); précédent : 000080; suivant : 000082Automatic summarization of soccer highlights using audio-visual descriptors
Auteurs : A. Ravent S [Espagne] ; R. Quijada [Espagne] ; Luis Torres [Espagne] ; Francesc Tarrés [Espagne]Source :
- SpringerPlus ; 2015.
Abstract
Automatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that render quite limited results due to the complexity of the problem and to the low capability of the descriptors to represent semantic content. In this paper, a new approach for automatic highlights summarization generation of soccer videos using audio-visual descriptors is presented. The approach is based on the segmentation of the video sequence into shots that will be further analyzed to determine its relevance and interest. Of special interest in the approach is the use of the audio information that provides additional robustness to the overall performance of the summarization system. For every video shot a set of low and mid level audio-visual descriptors are computed and lately adequately combined in order to obtain different relevance measures based on empirical knowledge rules. The final summary is generated by selecting those shots with highest interest according to the specifications of the user and the results of relevance measures. A variety of results are presented with real soccer video sequences that prove the validity of the approach.
Url:
DOI: 10.1186/s40064-015-1065-9
PubMed: 26155440
PubMed Central: 4485672
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000092
- to stream Pmc, to step Curation: 000092
- to stream Pmc, to step Checkpoint: 000065
- to stream Ncbi, to step Merge: 000816
- to stream Ncbi, to step Curation: 000816
- to stream Ncbi, to step Checkpoint: 000816
- to stream Main, to step Merge: 000080
- to stream Main, to step Curation: 000081
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Automatic summarization of soccer highlights using audio-visual descriptors</title><author><name sortKey="Ravent S, A" sort="Ravent S, A" uniqKey="Ravent S A" first="A" last="Ravent S">A. Ravent S</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author><author><name sortKey="Quijada, R" sort="Quijada, R" uniqKey="Quijada R" first="R" last="Quijada">R. Quijada</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author><author><name sortKey="Torres, Luis" sort="Torres, Luis" uniqKey="Torres L" first="Luis" last="Torres">Luis Torres</name><affiliation wicri:level="2"><nlm:aff id="Aff2">Signal Theory and Communications Department, UPC-BARCELONATECH, Jordi Girona 1-3, 08034 Barcelona, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Jordi Girona 1-3, 08034 Barcelona</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author><author><name sortKey="Tarres, Francesc" sort="Tarres, Francesc" uniqKey="Tarres F" first="Francesc" last="Tarrés">Francesc Tarrés</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">26155440</idno><idno type="pmc">4485672</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4485672</idno><idno type="RBID">PMC:4485672</idno><idno type="doi">10.1186/s40064-015-1065-9</idno><date when="2015">2015</date><idno type="wicri:Area/Pmc/Corpus">000092</idno><idno type="wicri:Area/Pmc/Curation">000092</idno><idno type="wicri:Area/Pmc/Checkpoint">000065</idno><idno type="wicri:Area/Ncbi/Merge">000816</idno><idno type="wicri:Area/Ncbi/Curation">000816</idno><idno type="wicri:Area/Ncbi/Checkpoint">000816</idno><idno type="wicri:Area/Main/Merge">000080</idno><idno type="wicri:Area/Main/Curation">000081</idno><idno type="wicri:Area/Main/Exploration">000081</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Automatic summarization of soccer highlights using audio-visual descriptors</title><author><name sortKey="Ravent S, A" sort="Ravent S, A" uniqKey="Ravent S A" first="A" last="Ravent S">A. Ravent S</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author><author><name sortKey="Quijada, R" sort="Quijada, R" uniqKey="Quijada R" first="R" last="Quijada">R. Quijada</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author><author><name sortKey="Torres, Luis" sort="Torres, Luis" uniqKey="Torres L" first="Luis" last="Torres">Luis Torres</name><affiliation wicri:level="2"><nlm:aff id="Aff2">Signal Theory and Communications Department, UPC-BARCELONATECH, Jordi Girona 1-3, 08034 Barcelona, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Jordi Girona 1-3, 08034 Barcelona</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author><author><name sortKey="Tarres, Francesc" sort="Tarres, Francesc" uniqKey="Tarres F" first="Francesc" last="Tarrés">Francesc Tarrés</name><affiliation wicri:level="2"><nlm:aff id="Aff1">Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels, Spain</nlm:aff><country xml:lang="fr">Espagne</country><wicri:regionArea>Signal Theory and Communications Department, UPC-BARCELONATECH, Esteve Terradas, 7, 08860 Castelldefels</wicri:regionArea><placeName><region nuts="2" type="communauté">Catalogne</region></placeName></affiliation></author></analytic><series><title level="j">SpringerPlus</title><idno type="e-ISSN">2193-1801</idno><imprint><date when="2015">2015</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Automatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that render quite limited results due to the complexity of the problem and to the low capability of the descriptors to represent semantic content. In this paper, a new approach for automatic highlights summarization generation of soccer videos using audio-visual descriptors is presented. The approach is based on the segmentation of the video sequence into shots that will be further analyzed to determine its relevance and interest. Of special interest in the approach is the use of the audio information that provides additional robustness to the overall performance of the summarization system. For every video shot a set of low and mid level audio-visual descriptors are computed and lately adequately combined in order to obtain different relevance measures based on empirical knowledge rules. The final summary is generated by selecting those shots with highest interest according to the specifications of the user and the results of relevance measures. A variety of results are presented with real soccer video sequences that prove the validity of the approach.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Bastan, M" uniqKey="Bastan M">M Bastan</name></author><author><name sortKey="Cam, H" uniqKey="Cam H">H Cam</name></author><author><name sortKey="Gudukbay, U" uniqKey="Gudukbay U">U Gudukbay</name></author><author><name sortKey="Ulusoy, O" uniqKey="Ulusoy O">O Ulusoy</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Datta, R" uniqKey="Datta R">R Datta</name></author><author><name sortKey="Joshi, D" uniqKey="Joshi D">D Joshi</name></author><author><name sortKey="Li, J" uniqKey="Li J">J Li</name></author><author><name sortKey="Wang, Jz" uniqKey="Wang J">JZ Wang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ekin, A" uniqKey="Ekin A">A Ekin</name></author><author><name sortKey="Tekalp, Ma" uniqKey="Tekalp M">MA Tekalp</name></author><author><name sortKey="Mehrotra, R" uniqKey="Mehrotra R">R Mehrotra</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Hanjalic, A" uniqKey="Hanjalic A">A Hanjalic</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hu, W" uniqKey="Hu W">W Hu</name></author><author><name sortKey="Xie, N" uniqKey="Xie N">N Xie</name></author><author><name sortKey="Li, L" uniqKey="Li L">L Li</name></author><author><name sortKey="Zeng, X" uniqKey="Zeng X">X Zeng</name></author><author><name sortKey="Maybank, S" uniqKey="Maybank S">S Maybank</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Karthirvel, P" uniqKey="Karthirvel P">P Karthirvel</name></author><author><name sortKey="Sabarimalai, M" uniqKey="Sabarimalai M">M Sabarimalai</name></author><author><name sortKey="Soman, P" uniqKey="Soman P">P Soman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kim, Hg" uniqKey="Kim H">HG Kim</name></author><author><name sortKey="Moreau, N" uniqKey="Moreau N">N Moreau</name></author><author><name sortKey="Sikora, T" uniqKey="Sikora T">T Sikora</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lavee, G" uniqKey="Lavee G">G Lavee</name></author><author><name sortKey="Rivlin, E" uniqKey="Rivlin E">E Rivlin</name></author><author><name sortKey="Rudzsky, M" uniqKey="Rudzsky M">M Rudzsky</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lew, Ms" uniqKey="Lew M">MS Lew</name></author><author><name sortKey="Sebe, N" uniqKey="Sebe N">N Sebe</name></author><author><name sortKey="Djeraba, C" uniqKey="Djeraba C">C Djeraba</name></author><author><name sortKey="Jain, R" uniqKey="Jain R">R Jain</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Phung, Sl" uniqKey="Phung S">SL Phung</name></author><author><name sortKey="Bouzerdoum, A" uniqKey="Bouzerdoum A">A Bouzerdoum</name></author><author><name sortKey="Chai, D" uniqKey="Chai D">D Chai</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Ren, W" uniqKey="Ren W">W Ren</name></author><author><name sortKey="Singh, S" uniqKey="Singh S">S Singh</name></author><author><name sortKey="Singh, M" uniqKey="Singh M">M Singh</name></author><author><name sortKey="Zhu, Ys" uniqKey="Zhu Y">YS Zhu</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sadlier, Da" uniqKey="Sadlier D">DA Sadlier</name></author><author><name sortKey="O Onnor, Ne" uniqKey="O Onnor N">NE O’Connor</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schoeffmann, K" uniqKey="Schoeffmann K">K Schoeffmann</name></author><author><name sortKey="Hopfgartner, F" uniqKey="Hopfgartner F">F Hopfgartner</name></author><author><name sortKey="Marques, O" uniqKey="Marques O">O Marques</name></author><author><name sortKey="Boeszoermenyi, L" uniqKey="Boeszoermenyi L">L Boeszoermenyi</name></author><author><name sortKey="Jose, Jm" uniqKey="Jose J">JM Jose</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sikora, T" uniqKey="Sikora T">T Sikora</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Smeaton, Af" uniqKey="Smeaton A">AF Smeaton</name></author><author><name sortKey="Over, P" uniqKey="Over P">P Over</name></author><author><name sortKey="Doherty, Ar" uniqKey="Doherty A">AR Doherty</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Viola, P" uniqKey="Viola P">P Viola</name></author><author><name sortKey="Jones, M" uniqKey="Jones M">M Jones</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wei, X" uniqKey="Wei X">X Wei</name></author><author><name sortKey="Yang, Y" uniqKey="Yang Y">Y Yang</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Xiong, Z" uniqKey="Xiong Z">Z Xiong</name></author><author><name sortKey="Zhou, S" uniqKey="Zhou S">S Zhou</name></author><author><name sortKey="Tian, Q" uniqKey="Tian Q">Q Tian</name></author><author><name sortKey="Rui, Y" uniqKey="Rui Y">Y Rui</name></author><author><name sortKey="Huang, Ts" uniqKey="Huang T">TS Huang</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Truong, Bt" uniqKey="Truong B">BT Truong</name></author><author><name sortKey="Venkatesh, S" uniqKey="Venkatesh S">S Venkatesh</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Yang, Mh" uniqKey="Yang M">MH Yang</name></author><author><name sortKey="Kriegman, Dj" uniqKey="Kriegman D">DJ Kriegman</name></author><author><name sortKey="Ahuja, N" uniqKey="Ahuja N">N Ahuja</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ying, L" uniqKey="Ying L">L Ying</name></author><author><name sortKey="Shih Hung, L" uniqKey="Shih Hung L">L Shih-Hung</name></author><author><name sortKey="Chia Hung, Y" uniqKey="Chia Hung Y">Y Chia-Hung</name></author><author><name sortKey="Kuo, C Cj" uniqKey="Kuo C">C-CJ Kuo</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Yuan, J" uniqKey="Yuan J">J Yuan</name></author><author><name sortKey="Wang, H" uniqKey="Wang H">H Wang</name></author><author><name sortKey="Xiao, L" uniqKey="Xiao L">L Xiao</name></author><author><name sortKey="Zheng, W" uniqKey="Zheng W">W Zheng</name></author><author><name sortKey="Li, J" uniqKey="Li J">J Li</name></author><author><name sortKey="Lin, F" uniqKey="Lin F">F Lin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zawbaa, Hm" uniqKey="Zawbaa H">HM Zawbaa</name></author><author><name sortKey="El Bendary, N" uniqKey="El Bendary N">N El-Bendary</name></author><author><name sortKey="Ella Hassanien, A" uniqKey="Ella Hassanien A">A Ella Hassanien</name></author><author><name sortKey="Kim, T" uniqKey="Kim T">T Kim</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct></listBibl></div1></back></TEI><affiliations><list><country><li>Espagne</li></country><region><li>Catalogne</li></region></list><tree><country name="Espagne"><region name="Catalogne"><name sortKey="Ravent S, A" sort="Ravent S, A" uniqKey="Ravent S A" first="A" last="Ravent S">A. Ravent S</name></region><name sortKey="Quijada, R" sort="Quijada, R" uniqKey="Quijada R" first="R" last="Quijada">R. Quijada</name><name sortKey="Tarres, Francesc" sort="Tarres, Francesc" uniqKey="Tarres F" first="Francesc" last="Tarrés">Francesc Tarrés</name><name sortKey="Torres, Luis" sort="Torres, Luis" uniqKey="Torres L" first="Luis" last="Torres">Luis Torres</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Musique/explor/MozartV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000081 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000081 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Musique
|area= MozartV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= PMC:4485672
|texte= Automatic summarization of soccer highlights using audio-visual descriptors
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Exploration/RBID.i -Sk "pubmed:26155440" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd \
| NlmPubMed2Wicri -a MozartV1
| This area was generated with Dilib version V0.6.20. |  |